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(57) In a stereoscopic image display apparatus 

for guiding a parallax image displayed on a display to 
the left eye and to the right eye of an observer by use of 
an optical system, thereby permitting stereoscopic 
observation of information of the image displayed on the 
display, the parallax image is comprised of a plurality of 
original parallax images for the left and right eyes and 
each of the left and right eyes is allowed observe the 
plurality of original parallax images simultaneously. The 
optical system has a vertical cylindrical lens array 
consisting of vertical cylindrical lenses having a 
generating line along a vertical direction, a lateral 
cylindrical lens array consisting of lateral cylindrical 
lenses having a generating line along a horizontal 
direction, and a mask pattern in which a plurality of 
transmitting portions and shield portions are arrayed at 
a predetermined pitch in the horizontal direction and in 
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Description 



BACKGROUND OF THE INVENTION 

5 

Field of the Invention 

[0001] The present invention relates to a stereoscopic image display apparatus having an image display portion 
for presenting independent images to the left and right eyes and constructed to be able to display stereoscopic 
10 images (parallax images) by the image display portion and, more particularly, to that suitable for stereoscopic 
observation of image information in good order in display devices of televisions, video cameras, computer monitors, 
game machines, and so on. 

Related Background Art 

15 

[0002] It is mentioned as to the conventional stereoscopic image display apparatus of this type that, after 
continuously observing the images (parallax images) displayed on this display apparatus, some observers feel 
fatigued in the eyes. 

[0003] One of the causes of this feeling of fatigue is said to be that on the occasion of the observation of the 
20 stereoscopic image the relation between binocular convergence and accommodation (focus adjustment) of eyes is 
different from that in everyday life. 

[0004] There is a close relation between binocular convergence and accommodation action of eyes. Namely, the 
eyes have such a property that if there is a change in the binocular convergence the accommodation of eyes will 
automatically follow it. 

25 [0005] On the other hand, in the case of the ordinary stereoscopic image display apparatus of the binocular 
parallax image method, the relation is preliminarily fixed between the optical system and the image display portion 
and one parallax image is presented per eye independently corresonding to each of the left and right eyes on the 
image display portion. Therefore, the binocular convergence can vary, but the variation over a certain range will cause 

3 0 a mismatch between the accommodation of eyes and the convergence. 

[0006] If the eyes are kept continuously in a state of failure in the accommodation of eyes, which has to be 
automatically effected in conjunction with convergence as described above, the observer can feel unnatural and this 
will possibly result in the observer feeling fatigued. 

[0007] In order to relieve the above feeling of fatigue, it is thus desirable to maintain the relation between the 
55 binocular convergence and the accommodation of eyes in the same state as that in everyday life. 

[0008] As a solution to the above problem, Japanese Patent Application Laid-Open No. 3-292093 discloses the 

suggestion that lenses of the optical system are arranged to be driven in accordance with the convergence, thereby 

permitting the accommodation of eyes. 
4Q [0009] Further, Japanese Patent Application Laid-Open No. 7-1 67633 discloses the suggestion that the left and 

right images are presented in the image display portion so that the binocular convergence can be equal to an angle 

according to the diopter of the optical system in the image display apparatus. 

[0010] The method suggested in the Japanese Patent Application Laid-Open No. 3-292093 necessitates a 
mechanical driving system and the apparatus tends to become larger. The method suggested in Japanese Patent 
45 Application Laid-Open No. 7-167633 has drawbacks that processing is first allowed after all data of one screen for 
each of the left and right eyes is once read in and that operation loads are large. It is thus difficult to continuously 
process all image frames. 

SUMMARY OF THE INVENTION 

50 

[0011] An object of the present invention is to provide a stereoscopic image display apparatus that can present 
image information in a state clos to the normal observation state to the observer and that thus poses no 
physiological contradiction betw en the convergence and the accommodation of the observer, whereby the observ r 
rarely feels fatigued during observation of ster oscopic image. 

55 

[0012] A stereoscopic image forming apparatus according to one aspect of the present invention is a 
stereoscopic image display apparatus comprising an observation position detecting mechanism for detecting an 
observation position of an observer and a display for displaying parallax images corr sponding to the left and right 
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eyes of the observer while controlling the parallax images so as to track information of the observation position, said 
stereoscopic image display apparatus permitting stereoscopic observation of the parallax imag s by use of the 
observation position detecting mechanism and the display, 

wherein the observation position detecting mechanism comprises pupil detecting means for detecting positions 
of the pupils of the eyes of the observer, and 

wherein each of the parallax images is comprised of a plurality of original parallax images for the left or right eye 
and each of the left and right eyes is allowed to observe the plurality of original parallax images simultaneously. 
[0013] A stereoscopic image display apparatus according to one aspect of the present invention is a 
10 stereoscopic image display apparatus for permitting stereoscopic observation of parallax images, using displays 
each of which displays a parallax image corresponding to the left or right eye of an observer, 

wherein at least one of the parallax images for the left and right eyes is comprised of a plurality of original 
parallax images. 

[0014] In one aspect of the present invention, in each of the above stereoscopic image forming apparatus, the 
15 plurality of original parallax images observed simultaneously by said left and right eyes are parallax images taken by 
a plurality of photographing devices under such setting that a separation between the plurality of photographing 
devices is equal to e, where e is a value close to or not more than half of a pupil diameter p. 
[001 5] In one aspect of the present invention, in each of the above stereoscopic image forming apparatus, said 
2Q display forms a mask pattern in which a plurality of transmitting portions and shield portions are arrayed at a 

predetermined pitch in a horizontal direction and in a vertical direction, on a display surface of an optical modulator 
having a discrete pixel structure, light from light source means is guided to the optical modulator to form patterned 
beams, an image display device having a discrete pixel structure and displaying a composite parallax image 
prepared by making use of scan lines is illuminated through optical means with the patterned beams, and beams 
25 based on the composite parallax image displayed on the image display device are guided to the left and right eyes of 
the observer, thereby permitting the stereoscopic observation of image information. 

[0016] In one aspect of the present invention, in the above stereoscopic image forming apparatus, a pattern 
shape of the mask pattern in said optical modulator is varied based on information from said pupil detecting means. 
[0017] In one aspect of the present invention, in each of the above stereoscopic image forming apparatus, a 

30 

horizontal element of each of the transmitting portions in the mask pattern of said optical modulator is comprised of a 
plurality of pixels. 

[0018] A stereoscopic vision information photographing method according to one aspect of the present invention 
is a stereoscopic vision information photographing method comprising: 

35 

a first step of photographing a first left parallax image and a first right parallax image while keeping a distanc 
between photographing optical axes equal to k times a standard eye-to-eye distance E; and 

a second step of photographing a second left parallax image and a second right parallax image in such a 
40 photographing state that the distance between photographing optical axes is kept at k times the standard eye-to- 

eye distance E and that photographing positions are displaced by k times a distance e smaller than a standard 
pupil diameter. 



45 [0019] In one aspect of the present invention, the above parallax image forming method comprises a step of 
forming at least one of parallax images for left and right eyes by alternately arranging first parallax partial images of 
the one parallax image and second parallax partial images of the one parallax image. 

[0020] A stereoscopic image display apparatus according to one aspect of the present invention is a 
stereoscopic image display apparatus for guiding a parallax image displayed on a display to the left eye and to the 

50 

right eye of an observer by use of an optical system, thereby permitting stereoscopic observation of information of the 
image display d on the display, wherein said parallax image comprises a plurality of original parallax images for the 
left and right eyes and each of the left and right eyes is allowed to observ the plurality of original parallax images 
simultaneously. 

55 [0021] In one aspect of the pr sent invention, in the above stereoscopic image display apparatus, said optical 
system comprises a vertical cylindrical lens array consisting of vertical cylindrical lenses having a generating line 
along a vertical direction, a lateral cylindrical lens array consisting of lateral cylindrical lenses having a generating line 
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along a horizontal direction, and a mask pattern in which a plurality of transmitting portions and shield portions are 
arrayed at a predetermined pitch in the horizontal direction and in the vertical direction. 

[0022] In one aspect of the present invention, in the above stereoscopic image display apparatus, said optical 
system guides the parallax image displayed on said display to the left eye and to the right eye of said observer in the 
form of beams of a vertical stripe shape, and a horizontal width of parallax image areas formed at an observation 
position of the observer by the beams of the vertical stripe shape is set to a value not more than half of a pupil 
diameter of the observer. 

[0023] In one aspect of the present invention, in the above stereoscopic image display apparatus, n original 
parallax images (n is an integer not less than 2) forming said parallax image are images taken from view point 
positions spaced at intervals of a distance equal to a value not more than half of a pupil diameter of the observer. 
[0024] A stereoscopic image display apparatus according to one aspect of the present invention is a 
stereoscopic image display apparatus comprising a pupil position detecting mechanism for detecting positions of 
pupils of an observer, and an optical system for guiding beams based on a parallax image displayed on a display, to 
the left eye and to the right eye of the observer, thereby permitting stereoscopic observation of information of the 
image displayed on the display, wherein said parallax image is comprised of a plurality of original parallax images for 
the left and right eyes and projected positions of the beams based on the parallax image are controlled according to 
information about the positions of the pupils of the eyes of the observer, outputted from the pupil position detecting 
mechanism, whereby the plurality of original parallax images are observed through each of the pupils of the left and 
right eyes of the observer. 

[0025] In one aspect of the present invention, in the above stereoscopic image display apparatus, said optical 
system comprises a vertical cylindrical lens array consisting of vertical cyiindrical lenses having a generating line 
along a vertical direction, a lateral cylindrical lens array consisting of lateral cylindrical lenses having a generating line 
along a horizontal direction, and a mask pattern in which a plurality of transmitting portions and shield portions are 
arrayed at a predetermined pitch in the horizontal direction and in the vertical direction. 

[0026] In one aspect of the present invention, in the above stereoscopic image display apparatus, a pattern 
shape of said mask pattern is varied according to an eye-to-eye distance of the observer, based on the information 
from said pupil position detecting means, and the parallax images corresponding to the left and right eyes of the 
observer are controlled so as to be projected to the left and right eyes of the observer. 

[0027] In one aspect of the present invention, in the above stereoscopic image display apparatus, when said n 
original parallax images (n is an integer not less than 2) are projected into n areas of a vertical stripe shape at an 
observation position, a pattern shape of said mask pattern is switched to another periodically and a display of the 
parallax image displayed on said display is also switched to another in synchronism therewith, whereby the same 
parallax images are always projected into the associated areas of the parallax images of the vertical stripe shape 
projected to the observation position. 

[0028] A stereoscopic image display apparatus according to one aspect of the present invention is a 
stereoscopic image display apparatus for guiding a parallax image displayed on a display to the left eye and to the 
right eye of an observer by use of an optical system, thereby permitting stereoscopic observation of information of the 
image displayed on the display, wherein the parallax image is made by combination of six or more original parallax 
images and three or more original parallax images are observed through each of the pupils of the left and right eyes 
of the observer. 

[0029] In one aspect of the present invention, in the above stereoscopic image display apparatus, said optical 
system comprises a vertical cylindrical lens array consisting of vertical cylindrical lenses having a generating line 
along a vertical direction, a lateral cyiindrical lens array consisting of lateral cylindrical lenses having a generating line 
along a horizontal direction, and a mask pattern in which a plurality of transmitting portions and shield portions are 
arrayed at a predetermined pitch in the horizontal direction and in the vertical direction. 

[0030] In one aspect of the present invention, in the above stereoscopic image display apparatus, said optical 
system guides the parallax image displayed on said display to the left eye and to the right eye of said observer in the 
form of beams of a vertical stripe shape, and a horizontal width of parallax image areas formed at an observation 
position of the observer by the beams of the vertical stripe shape is set to a valu not more than half of a pupil 
diameter of the observer. 

[0031] In one aspect of the present invention, in the above stereoscopic image display apparatus, said parallax 
image is made by combination of n original parallax images where n is an integer satisfying 6 £ n and the n original 
parallax images are imag s taken from view point positions spaced at intervals of a distance equal to a value not 
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more than half of a pupil diameter of the observer. 

[0032] A st reoscopic image display apparatus according to one aspect of the present invention is a 
stereoscopic image display apparatus comprising a pupil position detecting mechanism for detecting positions of 
pupils of an observer, and an optical system for guiding beams based on a parallax image displayed on a display, to 

5 the left eye and to the right eye of the observer, thereby permitting stereoscopic observation of information of the 
image displayed on the display, wherein said parallax image is made by combination of six or more original parallax 
images, and projected positions of the beams based on the parallax image are controlled according to information 
about the positions of the pupils of the eyes of the observer, outputted from the pupil position detecting mechanism, 

10 whereby three or more original parallax images are observed through each of the pupils of the left and right eyes of 
the observer. 

[0033] In one aspect of the present invention, in the above stereoscopic image display apparatus, said optical 
system comprises a vertical cylindrical lens array consisting of vertical cylindrical lenses having a generating line 
along a vertical direction, a lateral cylindrical lens array consisting of lateral cylindrical lenses having a generating line 
15 along a horizontal direction, and a mask pattern in which a plurality of transmitting portions and shield portions are 
arrayed at a predetermined pitch in the horizontal direction and in the vertical direction. 

[0034] In one aspect of the present invention, in the above stereoscopic image display apparatus, a pattern 
shape of said mask pattern is varied according to an eye-to-eye distance of the observer, based on the information 
from said pupil position detecting means, and the parallax images corresponding to the left and right eyes of the 
observer are controlled so as to be projected to the left and right eyes of the observer. 
[0035] In one aspect of the present invention, in the above stereoscopic image display apparatus, said parallax 
image is made by combination of n original parallax images where n is an integer satisfying 6 < n, and when said n 
original parallax images are projected into n areas of a vertical stripe shape at an observation position, a pattern 
25 shape of said mask pattern is switched to another periodically and a display of the parallax image displayed on said 
display is also switched to another in synchronism therewith, whereby the same parallax images are always 
projected into the associated areas of the parallax images of the vertical stripe shape projected to the observation 
position. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0036] 

Fig. 1 is a diagram to show the overall mechanism in Embodiment 1 of the present invention; 
Fig. 2 is a system block diagram of Embodiment 1; 

Fig. 3 is a schematic diagram to show the major part of the display portion in Embodiment 1; 

Fig. 4 is an explanatory diagram to explain a mask pattern in Embodiment 1 of the present invention; 

Fig. 5 is an explanatory diagram to explain how to produce the composite parallax image in Embodiment 1 of the 
present invention; 

Fig. 6 is an explanatory diagram to explain how to produce the composite parallax image in Embodiment 1 of the 
present invention; 

Fig. 7 is an explanatory diagram to explain the optical action in Embodiment 1 of the present invention; 
Fig. 8 is an explanatory diagram to explain the optical action in Embodiment 1 of the pr sent invention; 
Fig. 9 is an explanatory diagram to explain the optical action in Embodiment 1 of the present invention; 
Fig. 10 is an explanatory diagram to explain the optical action in Embodiment 1 of the present invention; 
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Fig. 1 1 is an explanatory diagram to explain the composit parallax image and the display method of the mask 
pattern in Embodiment 1 of the present invention; 

Fig. 1 2 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
5 pattern in Embodiment 1 of the present invention; 

Fig. 13 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 1 of the present invention; 

10 

Fig. 14 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 1 of the present invention; 

Fig. 15 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
15 pattern in Embodiment 1 of the present invention; 

Fig. 1 6 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 1 of the present invention; 

20 

Fig. 1 7 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 1 of the present invention; 

Fig. 18A and Fig. 18B are explanatory diagrams to explain a method for producing original parallax images in 
25 Embodiment 1 of the present invention; 

Fig. 19 is a schematic diagram to show the major part of the display portion in Embodiment 2 of the present 
invention; 

30 

Fig. 20 is an explanatory diagram to explain the mask pattern in Embodiment 2 of the present invention; 

Fig. 21 is an explanatory diagram to explain how to produce the composite parallax image in Embodiment 2 of 
the present invention; 

35 

Fig. 22 is an explanatory diagram to explain how to produce the composite parallax image in Embodiment 2 of 
the present invention; 

Fig. 23A, Fig. 23B, and Fig. 23C are explanatory diagrams to explain the optical action in Embodiment 2 of the 
40 present invention; 

Fig. 24A, Fig. 24B, and Fig. 24C are explanatory diagrams to explain the optical action in Embodiment 2 of the 
present invention; 

45 

Fig. 25 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 2 of the present invention; 

Fig. 26 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
50 pattern in Embodiment 2 of the present invention; 

Fig. 27 is an explanatory diagram to xplain the composite parallax image and the display method of the mask 
pattern in Embodiment 2 of th present invention; 

55 Fig. 28 is an explanatory diagram to xplain the composite parallax image and the display method of the mask 

pattern in Embodiment 2 of th present invention; 
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Fig. 29 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 2 of the present invention; 

Fig. 30 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 2 of the present invention; 

Fig. 31 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 2 of the present invention; 

Fig. 32A and Fig. 32B are explanatory diagrams to explain a method for producing the original parallax images in 
Embodiment 2 of the present invention; 

Fig. 33 is a diagram to show the overall mechanism in Embodiment 3 of the present invention; 
Fig. 34 is a system block diagram of Embodiment 3 of the present invention; 

Fig. 35 is a schematic diagram to show the major part of the stereoscopic image display portion in Embodiment 
3 of the present invention; 

Fig. 36 is an explanatory diagram to explain the mask pattern in Embodiment 3 of the present invention; 

Fig. 37A and Fig. 37B are explanatory diagrams to explain a method for producing the original parallax images in 
Embodiment 3 of the present invention; 

Fig. 38 is an explanatory diagram to explain how to produce the composite parallax image in Embodiment 3 of 
the present invention; 

Fig. 39 is an explanatory diagram to explain the optical action in Embodiment 3 of the present invention; 

Fig. 40 is an explanatory diagram to explain the optical action in Embodiment 3 of the present invention; 

Fig. 41 is an explanatory diagram to explain the optical action in Embodiments of the present invention; 

Fig. 42 is an explanatory diagram to explain the optical action in Embodiment 3 of the present invention; 

Fig. 43 is an explanatory diagram to explain the optical action in Embodiment 3 of the present invention; 

Fig. 44 is an explanatory diagram to explain the optical action in Embodiment 3 of the present invention; 

Fig. 45A and Fig. 45B are explanatory diagrams to explain the composite parallax image and the display method 
of the mask pattern in Embodiment 3 of the present invention; 

Fig. 46 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 3 of the present invention; 

Fig. 47 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 3 of the present invention; 

Fig. 48 is a diagram to show the overall mechanism in Embodiment 4 of the present invention; 
Fig. 49 is a system block diagram of Embodiment 4 of the pr sent invention; 

Fig. 50 is an explanatory diagram to explain the mask pattern in Embodiment 4 of the present invention; 

EP 1045596 Printed from Mimosa 03/04/02 13:34:31 Page: 7 



EP 1 045 596 A2 



Fig. 51 is an explanatory diagram to explain a method for producing the original parallax images in Embodiment 
4 of the present invention; 

Fig. 52 is an explanatory diagram to explain how to produce the composite parallax image in Embodiment 4 of 
the present invention; 

Fig. 53 is an explanatory diagram to explain the optical action in Embodiment 4 of the present invention; 

10 

Fig. 54 is an explanatory diagram to explain the optical action in Embodiment 4 of the present invention; 

Fig. 55 is an explanatory diagram to explain the optical action in Embodiment 4 of the present invention; 
15 Fig. 56 is an explanatory diagram to explain the optical action in Embodiment 4 of the present invention; 

Fig. 57 is an explanatory diagram to explain the optical action in Embodiment 4 of the present invention; 

2Q Fig. 58 is an explanatory diagram to explain the optical action in Embodiment 4 of the present invention; 

Fig. 59A and Fig. 59B are explanatory diagrams to explain the composite parallax image and the display method 
of the mask pattern in Embodiment 4 of the present invention; 

25 Fig. 60 is an explanatory diagram to explain the composite parallax image and the display method of the mask 

pattern in Embodiment 4 of the present invention; 

Fig. 61 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 4 of the present invention; 

30 

Fig. 62 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 4 of the present invention; 

35 Fig. 63 is an explanatory diagram to explain the composite parallax image and the display method of the mask 

pattern in Embodiment 4 of the present invention; 

Fig. 64 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 4 of the present invention; 

40 

Fig. 65 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 4 of the present invention; and 

Fig. 66 is an explanatory diagram to explain the composite parallax image and the display method of the mask 
pattern in Embodiment 4 of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

50 

(Embodiment 1) 

[0037] Embodiment 1 of the stereoscopic image display apparatus according to the present invention will be 
described referring to Fig. 1 to Fig. 17. Fig. 1 is a diagram to show the overall mechanism of this Embodiment 1. 
55 [0038] In the same figure, EL and ER represent the left eye and the right eye of the observer, respectively, and 
100L and 100R display portions corresponding to the left eye and to the right eye. 

[0039] In th present sp cification the following description will be simplified by attaching L or R to the end of 
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each number representing members with identical action for the left and right eyes, while omitting the description of 
"for the left eye" or "for the right eye" at each occasion. 

[0040] Reference symbols 1 10L and 1 10R indicate transmission type image display devices of the liquid crystal 
or the like, which display images for the respective eyes EL, ER. 

5 [0041] Symbols 140L, 140R represent optical modulators of the liquid crystal or the like having the discrete pixel 
structure and symbols 150L and 150R backlight light sources (light source means). Two lenticular lenses. 120L or 
120R, 130L or 130R (optical means) having their respective generating-line directions perpendicular to each other 
are placed between the image display device 1 10L, 11 OR and the optical modulator 140L, 140R. 

10 [0042] Symbols 160L and 160R denote magnifying lenses, through which the images displayed on the image 
display devices 110L, 1 10R are observed at a predetermined magnification. 

[0043] Symbols 170L and 170R designate imaging lenses, each of which forms an image of the eye EL or ER of 

the observer on an image sensor 108L or 108R. Each of the image sensors 108L, 108R is comprised, for example, 

of a two-dimensional CCD sensor. 
15 [0044] Fig. 2 is a system block diagram for explaining the system of Embodiment 1. 

[0045] In the same figure, the image display devices 110L, 11 OR display composite parallax images (for 

observation of stereoscopic image (3D)), which will be detailed hereinafter, or ordinary two-dimensional images. 

[0046] Numeral 240 designates a display drive circuit, which drives the image display devices 1 1 0L, 1 1 0R so as 
2Q to display the composite parallax images, which will be detailed hereinafter, based on a signal from an image 

processing means 250. The image processing means 250 outputs information about display areas of the composite 

parallax images to a signal combining circuit 230. 

[0047] Symbols 21 0L and 210R denote video processing means for processing video signals from the image 
sensors 108L, 108Rto calculate the positions of the pupils of the observer's eyes. 
25 [0048] The information about the positions of the pupils of the observer's eyes, which is acquired by the video 
processing means 21 0L, 21 OR, is also outputted to the signal combining circuit 230. 

[0049] The signal combining circuit 230 generates information for driving the optical modulators 140L, 140R, 
based on the information from the image processing means 250 and from the video processing means 210L, 210R, 
and outputs the information to a modulator drive circuit 220. 

30 

[0050] The optical modulators 140L, 140R are driven by the modulator drive circuit 220 and each optical 
modulator displays a checkered mask pattern in an area corresponding to the area of the composite parallax image 
displayed on the image display device 110L or 1 10R and a uniform density in an area corresponding to the two- 
dimensional image display portion in the display surface thereof. 
35 [0051] Fig. 3 is a schematic diagram to show the major part of the display portion 100L corresponding to the left 
eye EL. The display portion 100R corresponding to the right eye also has the like structure. 

[0052] In Fig. 3, the optical modulator 140L having the discrete pixel structure forms the mask pattern 141 L 
consisting of light-transmitting portions (transmitting portions) 142L and light-intercepting portions (shield portions) 
143L. 

40 [0053] Symbol 1 30L designates a lateral lenticular lens (lateral cylindrical lens array) having the generating line 
along the horizontal direction X, in which a lot of plano-convex, lateral cylindrical lenses are arranged in the vertical 
direction Y. 

[0054] The lateral lenticular lens 130L is designed to have such a lens curvature as to image the transmitting 
portions 142L and shield portions 143L of the mask pattern 141Lon the image display surface of the image display 
device 1 10L. The lens pitch (width) V1 of the lateral lenticular lens 130L is so set as to correspond to the vertical width 
Vm of the transmitting portions 142L and shield portions 143Lof the mask pattern 141L. The present embodiment 
shows an example of the pitch V1 equal to two times the width Vm. 

[0055] Symbol 120L denotes a vertical lenticular lens (vertical cylindrical lens array) having the generating line 
50 along the vertical direction Y, in which a lot of plano-convex, vertical cylindrical lenses are arranged in the horizontal 

direction X. Each cylindrical lens forming the vertical lenticular lens 120L is designed to have such a lens curvature as 
to image the mask pattern 141 L at the observation position, 

[0056] The horizontal pitch Hm of the transmitting portions 142L and the shield portions 143L of the mask 
pattern 141 L is so set as to correspond to one pitch (width) H1 of the vertical cylindrical lenses of the vertical 
55 lenticular lens 120L. 

[0057] Fig. 3 is illustrated with excluding glass covers, sheet polarizers, electrodes, etc. of the image display 
device 110L and th optical modulator 140L and with schematically illustrating the display image and the mask 
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pattern on the display surfaces. 

[0058] Now, the mask pattern 141 L consisting of the transmitting portions 142L and the shield portions 143L 
displayed on the optical modulator 140L will be described referring to Fig. 4. 
[0059] Fig. 4 is a front elevation of the mask pattern 141 L illustrated in Fig. 3. 

[0060] As illustrated in the same figure, the mask pattern 141 L is comprised of the transmitting portions 142L 
and the shield portions 143L having the horizontal pitch Hm and the vertical width Vm. A transmitting portion 142L is 
composed of three pixels 144L, 145L, and 146L, while a shield portion 143L is composed similarly of three pixels. 
Each portion can be controlled independently. 

[0061] Next, the composite parallax images displayed on the image display devices 110L, 11 OR will be 
described referring to Fig. 5 and Fig. 6. 

[0062] For the left eye EL, as illustrated in Fig. 5, two original parallax images GL(1), GL(2) corresponding to the 
left eye EL are divided each into a lot of stripe images of the horizontal stripe shape as illustrated and the element 
stripe images GL(1)i, GL(2)i thus obtained are alternately rearranged line by line on respective scan lines, thereby 
forming a composite parallax image GL(1, 2). 

[0063] Likewise, for the right eye ER, as illustrated in Fig. 6, two original parallax images GR(1), GR(2) 
corresponding to the right eye ER are divided each into a lot of stripe images of the horizontal stripe shape as 
illustrated and the stripe images GR(1)i, GR(2)i thus obtained are alternately rearranged line by line on respective 
scan lines, thereby forming a composite parallax image GR(1, 2). In the present invention the composite parallax 
image may also be formed for at least one of the left and right eyes. 

[0064] A method for producing the original parallax images GL(1), GL(2), GR(1), GR(2) will be described below 
referring to Figs. 18A and 18B. 

[0065] Fig. 18B is an explanatory diagram to explain a method for producing the original parallax images, for 
example, using four video cameras CL(1), CL(2), CR(1), CR(2). Production of original parallax images by CG is also 
based on this method. 

[0066] The parallax images used in the ordinary stereoscopic display apparatus of the binocular parallax imag 
method are normally parallax images of images GL, GR taken by two cameras CL, CR set with their optical axes 
parallel to each other and spaced at the difference equal to the separation E between the two eyes of a man 
(standard eye-to-eye distance) as illustrated in Fig. 18A. In the case of still images the images can also be taken by a 
single camera while moving it in parallel. 

[0067] It is, however, noted that the parallax images are produced by properly setting the distance between the 
optical axes of the cameras or the distance in the parallel movement according to such conditions as the size of the 
display screen, the distance from the observer to the screen, the magnification of the display image to an actual 
object, and so on. 

[0068] In contrast with it, the original parallax images used in the present Embodiment 1 are obtained as 
follows; under such conditions that E is the standard eye-to-eye distance and e is a value close to half of the standard 
pupil diameter p of eyes (for example, e = (P/2) ± (P/10)), images are taken by the cameras CL(1), CL(2), CR(1), 
CR(2) located as illustrated in Fig. 18B and the images taken by the cameras GL(1), GL(2) are used as the original 
parallax images corresponding to the left eye, while the images taken by the cameras GR(1), GR(2) as the original 
parallax images corresponding to the right eye. 

[0069] Just as the distance E between the optical axes of the cameras is set optionally in the case of the ordinary 
binocular parallax image method, the distance E between the optical axes of the cameras and the value of e may 
also be set optionally while keeping the ratio of e/E constant in the case of the present embodiment, however. 
[0070] Next, the details of the display of parallax image for the left eye will be described referring to Fig. 7 to Fig. 
10. The same can also apply to the right eye, though the description thereof will be omitted. 
[0071] Fig. 7 is a horizontal cross-sectional view (X-Z cross section) of the display portion illustrated in Fig. 3. 
[0072] In the same figure, light from the backlight light source 150L emerges from the transmitting portions 142L 
of the mask pattern 1 41 L of the optical modulator 140L and travels through the horizontal cylindrical lens 130L. (The 
horizontal lenticular lens has no specific action in this cross-sectional direction.) 

[0073] Then the cylindrical lens s forming the vertical lenticular lens 120L project beams of transmitted light from 
the transmitting portions 142L into an illuminated parallax image area GSL1 at the position of the left eye EL of the 
observer. 

[0074] The beams projected into the illuminated parallax image area GSL1 are modulated by the composite 
parallax image display d on the image display device 1 10L provided between th v rtical I nticular lens 120L and 
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the observer's left eye EL. In this cross section the beams travel, for example, through the element stripe images 
GL(1)1, GL(1)3, GR(1)5,... of the original parallax image GL(1) forming the composite parallax image GL(1, 2) 
illustrated in Fig. 5, and thus the original parallax image GL(1) is observed in the illuminated parallax image area 
GSL1. 

[0075] Since each of the transmitting portions 142Lof the mask pattern 141 L is composed of three pixels 144L, 
145L, 146L, beams passing through the respective pixels are projected into corresponding areas 147L, 148L, 149L 
[0076] Similarly, as illustrated in Fig. 8, beams in a cross section corresponding to one scan line below or above 
the above-stated line of Fig. 7 in the image display device 11 0L are radiated into an illuminated parallax image area 
GSL2. The beams radiated into this illuminated parallax image area GSL2 are modulated by the composite parallax 
image displayed on the image display device 110L provided between the vertical lenticular lens 120L and the 
observer's left eye. In this cross section the beams travel through the element stripe images GL(2)2, GL(2)4, GL(2)6, 
... of the original parallax image GL(2) forming the composite parallax image GL(1 , 2) illustrated in Fig. 5, and thus the 
original parallax image GL(2) is observed in the illuminated parallax image area GSL2. This area is also composed 
of three partial areas. 

[0077] Fig. 9 is a vertical cross-sectional view (Y-Z cross section) of the display portion of Fig. 3. In this cross 
section images of the transmitting portions 142L of the mask pattern 141 L illuminated by the backlight light sourc 
150L are formed on the image display surface of the image display device 110L by the action of the horizontal 
lenticular lens 130L, and on that occasion the images are formed at such a magnification that the width of the 
transmitting portions 142L of the optical modulator 140L becomes equal to the pixel width of the image display 
device 110L For that reason, for example, only the element stripe images of the original parallax image of GL(1) 
become irradiated by properly setting the positions of the optical modulator 140L, the image display device 1 10L, and 
the horizontal lenticular lens 130L 

[0078] Similarly, as illustrated in Fig. 10, only the element stripe images of the original parallax image GL(2) are 
irradiated in a pixel column one pixel next to that in Fig. 9. 

[0079] When the pupil (pupil diameter p) of the left eye EL is located at the border between the illuminated 
parallax image areas GSL1, GSL2, the observer's left eye can observe the original parallax images GL(1), GL(2) 
passing separately and independently, at the pupil portion accordingly. 

[0080] Fig. 11 to Fig. 13 are explanatory diagrams to schematically show this action in an easy-to-understand 
way. In Fig. 11, a diagram on the left side shows the principal part of the horizontal cross-sectional view (X-Z cross 
section) and on the right side there are the mask pattern 141 L displayed on the optical modulator 140L, the 
composite parallax image 111L displayed on the image display device 110L, and a projected parallax image 190L 
projected to the observer's position. 

[0081] The projected parallax image 190L is composed of the original parallax images GL(1), GL(2). Fig. 11 
shows a situation in which the pupil ELp of the observer's left eye EL is located at the position of the border between 
the original parallax images GL(1), GL(2) and the beams of the parallax images are projected to the pupil in such an 
order that the parallax images can be observed in a normal state, i.e., in the order of GL(1)and GL(2) from the right, 
for example. 

[0082] When the observer moves from this state to the left up to the state of Fig. 12 or to the right up to the state 
of Fig. 13, i.e., when the original parallax images are observed in the order of GL(2) and GL(1) opposite to that in Fig. 
1 1 by the pupil ELp of the left eye EL, the direction of parallax is reverse and it is thus an abnormal state different from 
that where the observer observes normal real scenes. 

[0083] Next described with Fig. 2 and Fig. 14 to Fig. 17 is the function for permitting the observer to always 
observe the parallax images in the normal order even with change in the pupil position of the observer's eye. 
[0084] This function is achieved in such a way that, receiving the information of the pupil position of the 
observer's eye acquired by the video processing means 21 0L illustrated in the system block diagram of Fig. 2, the 
modulator drive circuit 220 varies the pattern shape of the mask pattern 141 L displayed on the optical modulator 
140L in accordance with the view point. 

[0085] A method for detecting the pupil position of eye can b ither of known methods for projecting infrared 
light to the eye, d tecting the border between the white part and black part of the eye from an image of the eye 
captured by the image sensor 1 08L, and computing the position of the center of the pupil therefrom, for example. 
[0086] Fig. 14 is the same figure as the right-side diagram of Fig. 11, in which the left eye observes th original 
parallax images GL(1), GL(2) and which thus illustrates the state of normal observation of parallax images. 
[0087] At this time the center of the pupil ELp is located at the border between ar as 9 and 10 of the project d 
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parallax imag 1 90L. When the position of the pupil ELp moves from this state, for example, when the center of the 
pupil ELp is located at the border between areas 8 and 9, as illustrated in Fig. 15, the transmitting portions 142L of 
the mask pattern 141 L are moved one pixel to the left as illustrated, without changing the composite parallax image 
111L of the image display device. This causes the projected parallax image 190L to move entirely to the left by the 
5 distance of an area corresponding to one pixel. 

[0088] This control can retain the state in which the center of the pupil is present at the border between the 
original parallax images GL(1), GL(2), even after the movement of the observer's eye. 

[0089] When the position of the pupil ELp moves to the right up to a state in which the center of the pupil ELp is 
10 located at the border between areas 10, 11 of the projected parallax image 190L as illustrated in Fig. 16, the 
transmitting portions 142L of the mask pattern 141 L are moved one pixel to the right as illustrated, without changing 
the composite parallax image 1 1 1 L of the image display device, whereby the projected parallax image 1 90L moves to 
the right by the distance of the area corresponding to one pixel. 

[0090] When the pupil ELp moves further from this state to the right and goes into the state of Fig. 17, the 
1 5 projected parallax image 1 90L can be moved further to the right by the distance of the area corresponding to one pixel 
by further moving the mask pattern 141 L one pixel to the right as illustrated. 

[0091] When like control is carried out against movement of the pupil of the observer, the apparatus can maintain 
the state in which the center of the pupil is present at the border between the original parallax images GL(1), GL(2) 
and under the same sequence thereof. 

[0092] Although the above described the action for the left eye, the same can also apply to the right eye. 
[0093] As described above, the present embodiment uses the two original parallax images for each of the left 
and right eyes, i.e., the four original parallax images in total and is set to display the mask patterns while 
successively switching them in accordance with the pupil positions of the left and right eyes, control the projected 
25 parallax image areas corresponding to the left and right eyes in accordance with the pupil positions of the left and 
right eyes, and make the two different parallax images independently observed through each of the pupils of the left 
and right eyes, thereby simultaneously effecting the convergence function by the binocular parallax images and the 
accommodation function of the eyes and thus enabling to provide the stereoscopic image display apparatus with little 
fatigue of the eyes. 

[0094] In the present invention the apparatus may also be arranged to guide a plurality of original parallax 
images to at least one of the left and right eyes. 
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(Embodiment 2) 



[0095] Embodiment 1 of the present invention was the stereoscopic image display apparatus enabling each of 
the left and right eyes to observe the two parallax images. 

[0096] In contrast with it, Embodiment 2 provides the stereoscopic image display apparatus enabling each of the 
left and right eyes to observe three or more parallax images, which permits observation of stereoscopic image while 
40 relaxing the contradiction more between the convergence function by the binocular parallax images and the 
accommodation function of the both eyes and which is relaxed in required position accuracy concerning the tracking 
control of the pupil positions. 

[0097] The stereoscopic image display apparatus of Embodiment 2 will be described with placing the focus 
mainly on the difference from Embodiment 1, by reference to Figs. 19 to 32A and 32B. The whole mechanism 
45 diagram of Fig. 1 and the system block diagram of Fig. 2 are also applied to Embodiment 2. 

[0098] Fig. 19 is a schematic diagram to show the major part of the display portion for the left eye, which 
corresponds to Fig. 3 of Embodiment 1 . The display portion for the right eye also has the like structure. 
[0099] In the following description members having the function comparable to those in Embodiment 1 will be 
denoted by identical reference numbers. Embodiment 2 is different from Embodiment 1 in the contents of the 
composite parallax image displayed on the image display device 110L, in the contents of the mask pattern 141 L 
displayed on the optical modulator 140L, and in the specifications of the vertical lenticular lens 120L and the lateral 
lenticular lens 130L in accordance ther with. 

[0100] Namely, in Embodiment 2 the composite parallax image is comprised of six original parallax images and 
55 one pitch of the pattern of th transmitting portions and shield portions of th mask patt rn 141 L is comprised of six 
pixels. 

[0101] The pitch of each of the vertical and lateral lenticular lenses 120L, 130L is a value corresponding to six 
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pixels. 

[0102] Now, the mask pattern 141L composed of the aperture portions and shield portions displayed on the 
display surface of the optical modulator 140L will be described referring to Fig. 20. Fig. 20 is a front elevation of the 
mask pattern 141 L illustrated in Fig. 19. 

[0103] As illustrated in the figure, the mask pattern 141 L is composed of the aperture portions 142Land shield 
portions 143L having the horizontal pitch Hm and the vertical width Vm. 

[0104] The horizontal pitch Hm is comprised of m pixels where m is an integer not less than 2, and the vertical 
width Vm is comprised of one pixel. The figure shows the case of m = 6. 

[0105] Next, the composite parallax image displayed on the image display 110L will be explained referring to Fig. 
21 and Fig. 22. 

[0106] For the left eye, as illustrated in Fig. 21 , the composite parallax image GL(1-6) is produced by dividing six 
original parallax images GL(1) to GL(6) for the left eye into a lot of stripe images of the horizontal stripe shape as 
illustrated and rearranging the element stripe images GL(1 )i to GL(6)i line by line on the scan lines. 
[0107] Similarly, for the right eye, as illustrated in Fig. 22, the composite parallax image GR(1-6) is produced by 
dividing six original parallax images GR(1 ) to GR(6) for the right eye into a lot of stripe images of the horizontal stripe 
shape as illustrated and rearranging the element stripe images GR(1)i to GR(6)i line by line on the scan lines. 
[0108] Next, a method for producing these original parallax images will be described referring to Figs. 32A and 
32B. 

[0109] Under the conditions that E is the standard eye-to-eye distance and e is a value not more than half of the 
standard pupil diameter p of eyes, images are taken by cameras CL(1) to CL(6)forthe left eye and cameras CR(1) to 
CR(6) for the right eye placed as illustrated, and the images thus taken are used as the original parallax images. It is, 
however, noted that the values of E and e may also be set arbitrarily while maintaining the ratio e/E, in accordance 
with the photographing conditions and observation conditions, as in the case of Embodiment 1 . 
[0110] These original parallax images may also be images produced by CG, of course. 
[0111] Next described are the details of the display of the composite parallax image by reference to Figs. 23A to 
23C and Figs. 24A to 24C. Figs. 23A to 23C are horizontal cross-sectional views (X-Z cross sections) of the image 
display portion of Fig. 1 9. The structure and action for the right eye are also similar to those for the left eye except for 
the difference of the composite parallax image displayed, and thus the description thereof will be omitted. 
[0112] In the same figures, the light from the backlight light source 150L emerges from the aperture portions 
142L of the mask pattern 141L of the optica! modulator 140L to travel through the lateral cylindrical lenses 130L. (In 
this cross-sectional direction the lateral lenticular lens 130L has no specific action.) 

[0113] Then beams of the transmitted light by the mask pattern 141L are projected through the respective 
cylindrical lenses forming the vertical lenticular lens 120L into an areaeLI, as illustrated in Fig. 23A, in the form of a 
stripe beam having the width e at the observation position of the observer. 

[01 14] The beams projected into this area el_1 are modulated by the composite parallax image displayed on the 
image display device 1 10L provided between the vertical lenticular lens 120L and the observer. In this cross section, 
the beams travel, for example, through the element stripe parallax images GL(1)1, GL(1)7, GL(1)13,... of the original 
parallax image GL(1) illustrated in Fig. 21 and compose a projected stripe beam having the width e at the observation 
position. 

[0115] Similarly, as illustrated in Fig. 23B, beams in a cross section corresponding to a scan line one line below 
that of Fig. 23A are projected into an area eL2. The beams projected into this area el_2 are modulated by the 
composite parallax image displayed on the image display device 110L provided between the vertical lenticular lens 
120L and the observer. In this cross section, the beams travel through the element stripe parallax images GL(2)2, 
GL(2)8, GL(2)14,... of the original parallax image GL(2) illustrated in Fig. 21 and compose a projected stripe beam 
having the width e at the observation position. 

[0116] In the same manner thereafter, beams projected into the area e6 are beams passing through the 
element stripe parallax images GL(6)6, GL(6)1 2, GL(6)18,... of GL(6) as illustrated in Fig. 23C. 
[0117] Figs. 24A to 24C are vertical cross-sectional views (Y-Z cross sections) of the display portion of Fig. 19. 
[0118] In this cross section the aperture portions 142Lof the mask pattern 140L illuminated byth backlight light 
sourc 1 SOL are configured to be imaged at such a magnification as to equat the pixel width of the optical modulator 
140L with the pixel width of the image display device 1 10L on the image display surface of the image display device 
1 10L by the action of the lateral lenticular lens 130L. Th refore, for xample, only the element stripe images of the 
original parallax image of GL(1) are projected by properly setting the positions of the optical modulator 140L, the 
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image display devic 1 10L, and the lateral lenticular lens 130L. 

[0119] Similarly, in a pix I column one pixel next to that of Fig. 24A only the element stripe images of the original 
parallax image GL(2) are projected as illustrated in Fig. 24B. 

[0120] In the same manner thereafter, only the element stripe images of the original parallax image GL(6) are 
5 projected in Fig. 24C. 

[0121] When the pupil diameter of the observer's left eye is p and then the pupil is placed at the position 
illustrated in Figs. 23A to 23C, three or more stripe projected images are incident to the pupil of the observer. Fig. 25 
to Fig. 27 are explanatory diagrams to explain this action in easy-to-understand manner. 
10 [0122] In Fig. 25, the drawing on the left side shows the principal part of the horizontal cross-sectional view (X-Z 
cross section) of the display portion and on the right side there are the mask pattern 141 L of the optical modulator 
140L, the composite parallax image 11 1L displayed on the image display device 110L, and the projected parallax 
image 1 90L projected to the position of the observer. 

[0123] The projected parallax image 190L consists of the original parallax images GL(1) to GL(6) and Fig. 25 
15 shows the situation in the normal observation state in which the center of the pupil ELp of the left eye EL of the 
observer is located at the border position between the original parallax images GL(3) and GL(4) and in which the 
original parallax images of GL(2) to GL(5) are incident in the correct order to the pupil. 

[0124] If the observer moves from this state to the left, for example, up to the state of Fig. 26 or to the right, for 
20 example, up to the state of Fig. 27, the original parallax images incident to the pupil will include a portion of the 
reverse order of parallax and it will cause an abnormal state different from the state in which the observer observes 
normal real scenes. 

[0125] Next described using Fig. 28 to Fig. 31 is the function of always enabling the observation of parallax 
images in the normal order even with change in the pupil position of the observer's eye. 

25 [0126] The apparatus of the present Embodiment 2 is also constructed in such structure, similar to Embodiment 
1, that, receiving the information about the pupil position of the observer's eye acquired by the video processing 
means 21 0L illustrated in the system block diagram of Fig. 2, the modulator drive circuit 220 varies the pattern shape 
of the mask pattern 141 L displayed on the optical modulator 140L in accordance with the view point. 
[0127] Fig. 28 is the same figure as the diagram on the left side of Fig. 25, in which the original parallax images 

30 GL(2) to GL(5) are projected onto the pupil ELp, and shows the state of normal observation of parallax images. 

[0128] At this time the center of the pupil is located at the border between the areas 9, 10 of the projected 
parallax image 1 90L. When the position of the pupil ELp moves from this state, for example, when the center of the 
pupil is located at the left next border between the areas 8, 9 as illustrated in Fig. 29, the transmitting portions 142L of 

35 the mask pattern 141 L are moved one pixel to the left as illustrated, without changing the composite parallax image 
1 1 1L on the image display device. This causes the projected parallax image 190L to move to the left by the distance 
of the area corresponding to one pixel. 

[0129] This control can retain the state of the original parallax images GL (2) to GL(5) incident to the pupil in spite 
of the movement of the observer's eye. 

40 [0130] When the position of the pupil ELp moves to the right and goes into the state in which the center of the 
pupil is located at the border between the areas 1 0, 1 1 of the projected parallax image 1 90L as illustrated in Fig. 30, 
the transmitting portions 142L of the mask pattern 141L are moved one pixel to the right as illustrated, without 
changing the composite parallax image 111L on the image display device 110L, whereby the projected parallax 
image 190L is moved to the right by the distance of the area corresponding to one pixel as illustrated. When the 
observer further moves from this state to the right up to the state of Fig. 31, the mask pattern 141 L is moved further 
one pixel as illustrated, without changing the composite parallax image 1 1 1 L, whereby the projected parallax imag 
190L can be moved further to the right by the distance of the area corresponding to one pixel. 
[0131] By carrying out the like control against observer's motion to the left or to the right thereafter, the state of the 

50 original parallax images GL(2) to GL(5) incident to the pupil is maintained in spite of the movement of the pupil 
position. 

[0132] As described above, the composit parallax images are displayed while b ing switched according to the 
pupil positions of the left and right eyes, using six images for each of the left and right eyes, i.e., using totally twelve 
original parallax images, so as to control the projected parallax image areas corresponding to the left and right eyes 
55 in accordance with the pupil positions of the left and right eyes, whereby the observer can observ a plurality of 
different parallax images through each of the pupils of the left and right eyes. This enables to provide the 
stereoscopic image display apparatus with little fatigue of eyes while simultan ously effecting the convergence 
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function by the binocular parallax images and the accommodation function of the eyes. 

[0133] The above apparatus was described as to the case of m = 6, but the number of original parallax imag s 
incident to the pupil can be increased by increasing m, and a margin can be made in the tracking accuracy of the 
pupil positions by keeping constant the number of original parallax images incident to the pupil. 

5 [0134] In cases wherein the number of parallax images used is large, the observer observes images with 
degraded resolution in the vertical direction in the above structure, but, in order to avoid this degradation of resolution, 
it is effective to employ a method of time-division display to display the mask patterns and the composite parallax 
images in synchronism with each other. 

10 [0135] The present invention can present the following effects. 

(a) Since the plurality of parallax images are projected to each of the pupils of the left and right eyes of the 
observer, the stereoscopic observation with little fatigue is allowed while the contradiction is relieved between the 
binocular convergence and the accommodation function. 

15 

(b) Since the projection positions of the parallax images are controlled so as to follow the pupil positions of the 
eyes even with occurrence of positional deviation between the observer's eyes and the display devices, the 
parallax images can be kept in the normal state of the projection order of the parallax images incident to the pupil. 

20 

(c) When the number of parallax images projected is increased, the contradiction can be relieved more between 
the binocular convergence and the accommodation function. 

(d) When the number of parallax images projected is increased, the margin is made in the tracking control of the 
25 pupil positions of the eyes and it makes the production easier. 

(Embodiment 3) 

30 [0136] Embodiment 3 of the stereoscopic image display apparatus of the present invention will be described 
referring to Figs. 33 to 47 and Figs. 64 to 66. 

[01 37] Fig. 33 is a diagram to show the appearance of Embodiment 3 of the present invention. 

[0138] In the same figure, numeral 1 100 denotes the main body to show the whole of the stereoscopic image 

display apparatus. Numeral 1110 denotes an image display portion. Numeral 1111 represents a stereoscopic 
35 image display portion for displaying a stereoscopic image, inside the image display portion 1110. 

[0139] Fig. 34 is a system block diagram for explaining the system of Embodiment 3 of the present invention. 

[0140] In the same figure, the image display portion 1110 has a transmission type image display device 1 21 0 of 

the liquid crystal or the like, an optical modulator 1240 of the liquid crystal or the like having the discrete pixel 
40 structure, a light source means 1250, and two lenticular lenses 1220, 1230 having their respective generating line 

directions perpendicular to each other, which are disposed between the image display device 1210 and the optical 

modulator 1240. 

[0141] Stereoscopic images (parallax images) with parallax or ordinary two-dimensional images without 
parallax are displayed in the image display device 1210. The display area of the parallax images corresponds to the 
45 stereoscopic image display portion 1111 of Fig. 33. 

[0142] The image display device 1210 is driven by display drive circuit 1260 to display an image based on a 
signal from image processing means 1270 on the display surface thereof. 

[0143] The optical modulator 1240 is driven by modulator drive circuit 1320 to display the mask pattern described 
hereinafter in the area corresponding to the stereoscopic image display portion 1111 of the image display device 

50 

1210 and a uniform density in the two-dimensional image display area, on the display surface thereof. 
[0144] Th modulator driv circuit 1320 accepts the information about the siz and position of the stereoscopic 
image display portion 1111 displayed in the image display device 1210, and a synchronous signal of image display 
from the image processing means 1270, and controls the pattern shape of the mask pattern and the display position 
55 of the pattern, bas d on this information. 

[0145] Numeral 1280 indicates an observer of the stereoscopic image display apparatus (display). 

[0146] Fig. 35 is a schematic diagram to show the major part of the ster oscopic image display portion 1111. 
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[0147] In Fig. 35, numeral 1250 denotes the light source means, and 1240 the optical modulator, on the display 
surface of which the mask pattern 1241 acting as an optical barrier is formed. 

[0148] Numeral 1230 designates the lateral lenticular lens (lateral cylindrical lens array) having the generating 
line along the horizontal direction (X-direction), which is comprised of a lot of lateral cylindrical lenses of the plano- 

5 convex shape arranged in the vertical direction (Y-direction). The lateral lenticular lens 1230 is configured to have 
such a lens curvature as to image the mask pattern 1241 on the image display surface of the image display device 
1210. Further, the lens pitch (width) V1 of the lateral lenticular lens 1230 is so set as to correspond to the vertical 
width Vn of one unit pattern consisting of a plurality of transmitting portions and shield portions of the mask pattern 

,0 1241. 

[0149] Numeral 1220 designates the vertical lenticular lens (vertical cylindrical lens array) having the generating 
line along the vertical direction, which is comprised of a lot of vertical cylindrical lenses of the plano-convex shape 
arranged in the horizontal direction. Each cylindrical lens forming the vertical lenticular lens 1220 is designed to have 
such a lens curvature as to image the mask pattern 1241 at the observation position (1280). 
15 [0150] The horizontal width Hm of one unit pattern consisting of a plurality of transmitting portions and shield 
portions of the mask pattern 1241 is so set as to correspond to one pitch (the width) H1 of a vertical cylindrical lens of 
the vertical lenticular lens 1220. 

[0151] The image display device 1210 displays the composite parallax image 1211 consisting of a plurality of 
2Q units, each unit including an image composed of n original parallax images. 

[0152] One unit of the mask pattern 1241 corresponds to one unit pattern of the composite parallax image 1211 
in accordance with the area imaged by the lateral lenticular lens 1230, and the vertical width of one unit of the 
composite parallax image 1211 is Pv. 

[0153] Fig. 35 is illustrated with excluding the glass covers, polarizers, electrodes, etc. of the image display 
25 device 1210 and the optical modulator 1240. 

[0154] EL and ER represent the left eye and the right eye of the image observer 1280, respectively. 

[0155] Now, the mask pattern 1241 displayed on the optical modulator 1240 will be described referring to Fig. 

36. 

[0156] Fig. 36 is an enlarged front view of the mask pattern 1 241 illustrated in Fig. 35. 

30 

[0157] As illustrated in Fig. 36, the mask pattern 1241 is comprised of a plurality of unit patterns 1241a, each unit 
having the horizontal width Hm and the vertical width Vn while consisting of transmitting portions 1242 and shield 
portions 1 243 formed by the pixels of the optical modulator 1 240. 

[0158] Each unit pattern 1241a consists of n pixels vertical and m pixels horizontal, and the transmitting portions 
35 1242 are placed along the diagonal direction of each unit. However, m = n in Embodiment 3. 

[0159] Next, the composite parallax image 1211 displayed on the image display device 1210 will be explained 
referring to Fig. 37B and Fig. 38. 

[01 60] Figs. 37A and 37B are explanatory diagrams to explain a method for producing parallax images by use of 
a plurality of video cameras, for example. The production of parallax images by CG is also based on this method. 
40 [0161] It is common practice to prepare the parallax images used in the stereoscopic image display apparatus 
of the binocular parallax image method, using parallax images of the left eye image GL and the right eye image GR 
taken by two cameras CL, CR corresponding to the left and right eyes of the observer and placed apart at the 
distance corresponding to the separation E between the two eyes of a man (eye-to-eye distance) as illustrated in 
Fig. 37A. 

45 

[0162] Still images may also be photographed by a single camera by moving it in parallel. 
[0163] However, the parallax images are prepared by properly setting the distance between the optical axes of 
the cameras (or the distance of the parallel movement) in accordance with such conditions as the size of the display 
screen, the distance from the observer to the screen, the magnification of the display image to an actual object, and 
50 the like. 

[0164] In contrast with it, the parallax images used in this Embodiment 3 are prepared using the original parallax 
images of images G(1), G(2),..., G(n) taken by the cameras C(1), C(2),..., C(n) placed as illustrated in Fig. 37B under 
such a condition that e is a value not more than half of the pupil diameter p of the eyes. 

[01 65] As in the case of the ordinary binocular parallax image method where the distanc E between the optical 
55 ax s of the cam ras is set as occasion may demand, the valu of the distance e betwe n the optical axes of the 
cameras may also be s t optionally according to the observation conditions in the case of the present embodiment, 
how ver. 



EP 1045596 Printed from Mimosa 03/04/02 13:34:33 Page: 16 



20 



EP 1 045 596 A2 

[0166] It is also possible to set virtual cameras in software by CG (Computer Graphics) or th like, make CG 
images at view points from the respective camera from CG data, and us them as the original parallax images. 
[0167] Next described referring to Fig. 38 is a method for producing the composite parallax image 1211 
displayed on the image display device 1210 from the above original parallax images G(1), G(2),..., G(n). 
5 [0168] Each of the n original parallax images G(1), G(2),..., G(n) is divided into stripe images of the lateral stripe 
shape as illustrated, and the stripe images G(1)i, G(2)i,..., G(n)i, which are the elements of the original parallax 
images G(1), G(2),..., G(n), are rearranged line by line on scan lines, thereby producing images Gi(1-n) consisting of 
a plurality of units each unit including n horizontal stripe images. 
10 [0169] The images thus obtained are displayed as the composite parallax image 1211 on the image display 
device 1210. The description will be carried on assuming that the image of G1(1-n) in the figure is displayed. 
[01 70] Next, the details of the display of stereoscopic image will be explained referring to Fig. 39 to Fig. 44. 
[0171] Fig. 39 to Fig. 41 are horizontal cross-sectional views (X-Z cross sections) of the stereoscopic image 
display portion 1111 of Fig. 35. 
15 [0172] In Fig. 39, the light from the light source means 1250 emerges from the transmitting portions 1242 (the 
width Hmw) of the mask pattern 1241 of the optical modulator 1240 to travel through the lateral cylindrical lenses 
1230. (In this cross-sectional direction the lateral lenticular lens has no specific optical action.) 
[0173] Then beams of the transmitted light from the mask pattern 1241 are projected through the cylindrical 
lenses forming the vertical lenticular lens 1220 to irradiate an area e1 in the form of a stripe beam having the width e 
at the observation position of the observer. 
[0174] The beams projected into this area e1 are modulated by the composite parallax image 121 1 displayed on 
the image display device 1210 provided between the vertical lenticular lens 1220 and the observer. 
[0175] In this cross section, the beams travel, for example, through the element stripe parallax images G(1)1, 
25 G(1)n+1, G(1)2*n+1,„. of the original parallax image G(1) illustrated in Fig. 38 and are projected into the area e1 in the 
form of the projected stripe beam having the width e at the observation position. 

[0176] Likewise, as illustrated in Fig. 40, beams in a cross section corresponding to a scan line one line below 
that of Fig. 39 are projected into an area e2. The beams projected into this area e2 are modulated by the composite 
parallax image 1211 displayed on the image display device 1210 provided between the vertical lenticular lens 1220 
and the observer. In this cross section the beams travel through the element stripe parallax images G(2)2, G(2)n+2, 
G(2)2*n+2,„. of the original parallax image G(2) illustrated in Fig. 38 and are projected into the area e2 in the form of a 
projected stripe beam having the width e at the observation position. 

[0177] In the same manner thereafter, as illustrated in Fig. 41, beams projected into an area en are beams 
35 having passed through the element stripe parallax images G(n)n, G(n)2*n, G(n)3*n,... of G(n). 

[0178] Fig. 42 to Fig. 44 are vertical cross-sectional views (Y-Z cross sections) of the stereoscopic image display 
portion 1111 of Fig. 35. 

[0179] In Fig. 42, the transmitting portions 1242 of the mask pattern 1241 illuminated by the light source means 
1250 are projected onto the image display surface of the image display device 1210 by the action of the lateral 
40 lenticular lens 1230. (In this cross-sectional direction the vertical lenticular lens 1220 has no specific optical action.) 
On that occasion, the lateral lenticular lens acts so as to equate the width Vn of one unit pattern of the mask pattern 
1241 to the width Pv of one unit of the display image and image the transmitting portions (the width Vnw) of the mask 
pattern 1241 in the pixel width of the display image. Therefore, for example, only the element stripe images of the 
original parallax image of G(1) are irradiated by properly setting the positions of the optical modulator 1240, the 
image display device 1210, and the lateral lenticular lens 1230. 
[0180] Likewise, as illustrated in Fig. 43, only the element stripe images of the original parallax image G(2) are 
irradiated in a cross section of a pixel column laterally one pixel next to that of Fig. 42. 

[0181] In the same manner thereafter, only the element stripe images of the original parallax image G(n) are 
50 irradiated in Fig. 44. 

[0182] The structure of the optical system in the stereoscopic image display apparatus of the present invention 
will be described below by reference to Fig. 39. 

[0183] As illustrated in Fig. 39, let Lh2 be the distance between the vertical lenticular lens 1220 and the mask 
pattern 1241 (an optical separation obtained when the distance between the mask-side principal point of the vertical 
55 lenticular lens 1220 and the mask pattern 1241 is reduced to a value in air), Lh1 be th distance from the preset 
observation position 1280 to the vertical lenticular lens 1220 (an optical separation obtained when the distance 
between the observation position 1280 and the observer-side principal point of th vertical lenticular lens 1220 is 
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reduced to a value in air), Hmw be the horizontal width of the transmitting portions of the mask pattern 1241 , Hm be 
the horizontal width between the adjacent transmitting portions, H1 be the pitch (width) of the vertical cylindrical 
lenses forming the vertical lenticular lens 1220, E be the eye-to-eye distance, and e be the width of the projected 
stripe beams at the observation position. Then the system is configured so as to satisfy the following conditions. 
5 [0184] It is noted here that e is a value not more than p/2 where p is the pupil diameter of the eyes. 

e/Hmw==Lh1/Lh2 (1) 
Lh1/(Lh1 +Lh2) = H1/Hm (2) 
Hmw = Hm/m (3) 
10 e x n > E (4) 

[0185] When the left and right eyes EL, ER of the observer having the pupil diameter p are placed at the positions 
illustrated in Figs. 39 to 41, a plurality of, three or more, projected stripe images are incident simultaneously to each 
15 of the pupils of the left and right eyes EL, ER of the observer accordingly. 

[0186] Fig. 45A to Fig. 47 are explanatory diagrams to explain how to effect the stereoscopic vision in this 
structure. 

[01 87] Fig. 45A is an enlarged view of one pitch of the vertical lenticular lens 1 220 in the horizontal sectional view 
(X-Z cross section) of the stereoscopic image display portion 1111 and Fig. 45B shows the mask pattern 1241 
displayed on the optical modulator 1240, the composite parallax image 1211 displayed on the image display device 

1210, and the projected parallax image 1290 projected to the observation position. 

[0188] The projected parallax image 1290 is an image resulting from projection of the parallax images G(1) to 
G(n) in the vertical stripe shape. 
25 [0189] When the pupils ELp, ERp of the left eye EL and the right eye ER of the observer are located at the 
positions illustrated in Fig. 45B, the observer can simultaneously observe a plurality of parallax images through each 
of the left and right eyes, whereby the stereoscopic vision is allowed. 

[0190] When the observer moves left or right from this state, the normal stereoscopic vision is allowed in the 
range from the state of Fig. 46 in movement to the right to the state of Fig. 47 in movement to the left. 
[0191] The above structure and action allow each of the left and right eyes to observe three or more parallax 
images simultaneously, which enables to provide the stereoscopic image display apparatus with little fatigue of the 
eyes while simultaneously effecting the convergence function by the binocular parallax images and the 
accommodation function of the eyes. 
35 [0192] In the above description, the larger the number n of original parallax images constituting the composite 
parallax image 1 21 1 , the broader the area of stereoscopic vision, but the lower the vertical resolution of the display 
image. In order to solve it, the pattern shape of the mask pattern 1241 of the optical modulator 1240 is switched to 
another in synchronism with switching of the display contents of the image display of the composite parallax image 

1211, thereby enhancing the resolution. The number n of original parallax images is determined arbitrarily except for 
one. 

[0193] The details of that operation will be described below referring to Figs. 64 to 66. 

[0194] Fig. 64 is the same figure as Fig. 45B. Let this state be a first state. In a second state time-sequential 
thereto, as illustrated in Fig. 65, the opening portions of the mask pattern 1241 are moved by one pixel in the vertical 
direction and the element stripe images G(1)i, G(2)i,..., G(n)i of the composite parallax image 121 1 are also moved 
by one pixel in the vertical direction. 
[0195] Namely, the display of the composite parallax image is switched to G2(1-n) of Fig. 38. 
[0196] After this operation, the sequence and position of the parallax images in the projected parallax image 
1290 are kept in those in the first state as illustrated. 
50 [0197] In a third state, as illustrated in Fig. 66, the displays of the mask pattern 1241 and the composite parallax 
image 1211 are further moved similarly by one pixel. Namely, the opening portions of the mask pattern 1241 are 
moved by one pixel in the vertical direction and the display of the composit parallax image is also switch d to G3(1- 
n) of Fig. 38. 

[0198] In this case the sequence and position of the parallax images in the projected parallax image 1290 are 
also kept in those in the first state as illustrated. 

[0199] The like operation is carried out thereafter successively to the n-th state, whereby the same element 
parallax imag s can be displayed throughout the entire surface on the image display device without altering the 
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sequence and position of th projected parallax images at the observation position. 

[0200] The stereoscopic image display with improved resolution can be effected by displaying the first to the nth 
states as a cycle within the time of the after image effect of the eyes. 

5 

(Embodiment 4) 

[0201] Embodiment 4 of the stereoscopic image display apparatus of the present invention will be described 
next. Embodiment 3 of the present invention, described above, necessitates a lot of original parallax images. In 
contrast with it, Embodiment 4 presents the minimum number of parallax images to each of the left and right eyes, 
10 so as to decrease the number of original parallax images used and relax the contradiction between the convergence 
function by the binocular parallax images and the accommodation function, thereby providing the stereoscopic image 
display apparatus permitting the observation of stereoscopic image. 

[0202] The stereoscopic image display apparatus of Embodiment 4 will be described with placing the focus 
15 mainly on the difference from Embodiment 3, referring to Fig. 48 to Fig. 63. 

[0203] Fig. 48 is a drawing to show the appearance of the stereoscopic image display apparatus in Embodiment 
4 of the present invention. 

[0204] In Fig. 48, the present embodiment is different from Embodiment 3 in that the apparatus of the present 
embodiment has a pupil position detecting mechanism 1 1 20 for detecting the positions of the pupils of the left and 
20 right eyes of the observer. Numeral 1121 designates a video camera, which is a component of the pupil position 
detecting mechanism. 

[0205] Fig. 49 is a system block diagram of Embodiment 4 of the present invention. 

[0206] In Fig. 49 the image processing means 1270 outputs the signal of the image to be displayed on the 
25 image display device 1210, via the display drive circuit 1260 thereto and the information about the size and position of 
the stereoscopic image display portion and the synchronous signal of the image displayed on the image display 
device 1 21 0, to the signal combining circuit 1 330. 

[0207] The pupil position detecting mechanism 1120 outputs the information about the pupil positions of the 
observer to the signal combining circuit 1 330. 
30 [0208] The signal combining circuit 1330 generates information for driving the optical modulator 1240, based on 
these information, and outputs the information to the modulator drive circuit 1320. 

[0209] The optical modulator 1240 is driven by the modulator drive circuit 1320 to display the mask pattern in the 
area corresponding to the stereoscopic image display portion and display the uniform density in the area 
corresponding to the two-dimensional image display portion on the display surface thereof, which is the same as in 
35 Embodiment 3, but in Embodiment 4 the pattern shape of the mask pattern 1241 is also varied based on the pupil 
position information. 

[0210] The schematic diagram of the major part of Fig. 35 in Embodiment 3 is also applied to Embodiment 4. 
[0211] The present embodiment is different from Embodiment 3 in the contents of the composite parallax image 
40 121 1 displayed on the image display device 1210 and in the contents of the mask pattern 1241 displayed on the 
optical modulator 1240. 

[0212] The mask pattern 1 241 consisting of the transmitting portions and shield portions displayed in the optical 
modulator 1240 of Embodiment 4 will be explained referring to Fig. 50. 

[0213] As illustrated in Fig. 50, the mask pattern 1241 is comprised of a plurality of unit patterns, each unit 1241a 
45 having the horizontal width Hm and the vertical width Vn while consisting of transmitting portions 1242 and shield 
portions 1243 formed by pixels of the optical modulator 1240. 
[0214] Each unit pattern is composed of n pixels vertical and m pixels horizontal. 

[0215] In Embodiment 4 the transmitting portions 1242 are provided at only portions corresponding to the left 
5o and right eyes of the observer and the other portions are the shield portions as illustrated. The transmitting portions 
are only three pixels for each of the left and right eyes. 

[0216] Here n is equal to two times the number of parallax images corresponding to each of the left and right 
eyes and in Embodiment 4 n = 6. It is, however, noted that n can be any number not less than 6 as occasion may 
demand. 

55 [0217] Now, the composit parallax image 1211 displayed on the imag display device 1210 of Embodiment 4 
will be described referring to Fig. 51 and Fig. 52. 

[0218] Fig. 51 is an explanatory diagram to explain a method for producing the original parallax images, for 
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example, by use of video cameras. The production of parallax images by CG is also based on this method. 
[0219] The parallax images used in this Embodiment 4 are prepared by using images GL(-1), GL(0), GL(1), GR(- 
1), GR(0), GR(1) taken by the cameras for the left eye CL(-1), CL(0), CL(1) and the cameras for the right eye CR(-t), 
CR(0), CR(1) placed as illustrated under the conditions that E is the eye-to-eye distance and that e is a value not 
more than half of the pupil diameter p of the eyes, as original parallax images. 

[0220] It is, however, noted that the distance between the optical axes of the cameras may be set arbitrarily with 
keeping the value of e/E constant, as in the case of Embodiment 3. 

[0221] Next, the method for producing the composite parallax image 1211 displayed on the image display device 
1210 from the above original parallax images will be described referring to Fig. 52. 

[0222] Each of the three original parallax images GL(-1 ) to GL(1) or GR(-1 ) to GR(1 ) for each of the left and right 
eyes is divided into stripe images of the lateral stripe shape as illustrated and the stripe images GL(-1)i to GL(1)i, 
GR(-1)i to GR(1)i, which are elements of the original parallax images GL(-1) to GL(1), GR(-1) to GR(1), are 
rearranged line by line on scan lines, thereby forming the composite parallax image Gi(-1 to 1). 
[0223] The composite parallax image 121 1 prepared in this way is displayed on the image display device 1210. 
[0224] Next, the details of the display of the composite parallax image 121 1 will be described using Fig. 53 to 
Fig. 58. 

[0225] First explained is an example of the display of G1 (-1 to 1) as the composite parallax image 1211. 
[0226] Fig. 53 to Fig. 55 are horizontal cross-sectional views (X-Z cross sections) of the stereoscopic image 
display portion 1 1 1 1 of Fig. 35. 

[0227] In Fig. 53 the light from the light source means 1250 emerges from the transmitting portions 1242 of the 
mask pattern 1241 of the optical modulator 1240 to travel through the lateral cylindrical lenses 1230. (In this cross- 
sectional direction the lateral lenticular lens has no specific action.) 

[0228] Then the beams of the transmitted light from the mask pattern 1241 are projected through the cylindrical 
lenses forming the vertical lenticular lens 1220 to irradiate an area el_(-1) in the form of a stripe beam having the 
width e at the observation position of the observer. 

[0229] The beams projected into this area el_(-1) are modulated by the composite parallax image 1211 
displayed on the image display device 1210 provided between the vertical lenticular lens 1220 and the observer. In 
this cross section the beams travel, for example, through the element stripe parallax images GL(-1)1, GL(-1)7, GL(-1) 
13,... of the composite parallax image G1(-1 to 1) illustrated in Fig. 52 to become a projected stripe beam having the 
width e at the observation position, to be projected into the area eL(-1). Namely, the area eL(-1) is irradiated by the 
original parallax image GL(-1). 

[0230] Similarly, as illustrated in Fig. 54, beams in a cross section corresponding to a scan line one line below 
that of Fig. 53 are projected into an area el_(0). The beams projected into this area el_(0) are modulated by the 
composite parallax image 121 1 displayed on the image display device 1210 provided between the vertical lenticular 
lens 1220 and the observer. In this cross section the beams travel through the element stripe parallax images GL(0) 
2, GL(0)8, GL(0)14,... of the composite parallax image G1(-1 to 1) illustrated in Fig. 52 and become a projected stripe 
beam having the width e at the observation position to be projected into the area el_(0). Namely, the area el_(0) is 
illuminated by the original parallax image GL(0). 

[0231] Likewise, the area el_(1) is illuminated by the original parallax image GL(1). 
[0232] Further, the area eR(-1) is illuminated by the original parallax image GR(-1) as illustrated in Fig. 55. 
[0233] In the same manner thereafter, the areas eR(0) and eR(1) are illuminated by the original parallax images 
GR(0), GR(1) t respectively. 

[0234] Fig. 56 to Fig. 58 are vertical cross-sectional views (Y-Z cross sections) of the stereoscopic image display 
portion 1111 of Fig. 35. 

[0235] In Fig. 56, the transmitting portions 1242 of the mask pattern 1241 illuminated by the light source means 
1250 are projected onto the image display surface of the image display device 1210 by the action of the lateral 
lenticular lens 1230. (In this cross-sectional direction the vertical lenticular lens has no specific action.) 
[0236] On that occasion, the lateral lenticular lens 1 230 acts so as to equate the width Vn of one unit of the mask 
pattern 1 241 to the width Pv of one unit of the display image and image the transmitting portions (the width Vnw) of 
th mask patt rn in the pixel width of the display image. Therefore, for example, only the lement stripe images of the 
original parallax image of G1(-1) are irradiat d by properly setting the positions of the optical modulator 1240, the 
image display device 1210, and the lateral lenticular lens 1230. 

[0237] Similarly, as illustrated in Fig. 57, only the element stripe images of the original parallax image GL(0) are 
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irradiated in a cross s ction of a pixel column horizontally one pixel next to that of Fig. 56. 

[0238] In the same manner thereafter, only the element stripe images of the original parallax image GR(-1 ) are 
irradiated in Fig. 58. 

[0239] Therefore, the parallax images for the left and right eyes are the projected parallax images of the stripe 
5 shape independent of each other at the observation position 1 280. 

[0240] On that occasion, as illustrated in Fig. 53 to Fig. 55, the separation between el_(-1) to eL(1) for the left eye 

and eR(-1) to eR(1) for the right eye is controlled so as to be equal to the pupil distance E of the observer, based on 

the output from the pupil position detecting means 1 120. 
10 [0241] How to handle change of the pupil distance due to individual differences or differences of observation 

distance will be described hereinafter. 

[0242] In the above structure, when the left and right eyes EL, ER of the observer having the pupil diameter p are 
located at the positions illustrated in Figs. 53 to 55, a plurality of, two or more, projected stripe images are incident to 
each of the left and right pupils of the observer. 
15 [0243] Figs. 59A and 59B are explanatory diagrams to explain how the stereoscopic vision is made in this 
structure. 

[0244] Fig. 59A is a horizontal cross-sectional view (X-Z cross section) of the stereoscopic image display portion 
1111, which is an enlarged view of one pitch of the vertical lenticular lens, and Fig. 59B shows the mask pattern 1241 
20 displayed on the optical modulator 1240, the composite parallax image 121 1 displayed on the image display device 
1210, and the projected parallax image 1290 projected to the observer's position 1280. 

[0245] The projected parallax image 1290 is an image resulting from projection of the original parallax images 
GL(-1) to GL(1), GR(-1) to GR(1) in the stripe shape. 

[0246] These figures show the normal observation state of stereoscopic vision in which each of the pupils ELp, 
25 ERp of the left eye EL and the right eye ER of the observer is present in the projected parallax image area 
corresponding to either the left eye or the right eye. 

[0247] These figures show an example in which each of the left and right eyes observes three parallax images 
simultaneously. 

[0248] Next described is the function of always enabling the normal stereoscopic observation even with change 

30 

in the pupil positions of the observer's eyes because of movement of the observer. 

[0249] As described referring to Figs. 48 and 49, the apparatus of the present Embodiment 4 has the pupil 
position detecting means 1120 for detecting the pupil positions of the observer's eyes. 

[0250] The method proposed before in Japanese Patent Application No. 10-322139 by the inventor et al. can 
35 be utilized as the pupil position detecting means 1 120 of a non-contact type. 

[0251] The pattern shape of the mask pattern 1241 displayed on the optical modulator 1240 and the contents of 
the composite parallax image 1211 displayed on the image display device 1210 are controlled as follows, based on 
the information obtained by the pupil position detecting means 1120. 

[0252] Let the state of Fig. 59B be a reference. When the observer moves from this reference state in the lateral 
40 direction (X-direction), the transmitting portions and shield portions of the mask pattern 1241 are moved in the 
horizontal direction (X-direction) without changing the composite parallax image 1211. 

[0253] An amount of the movement is determined so that a movement of the projected parallax image 1290 due 
to the movement of the mask pattern 1241 is equal to the moving distance of the pupil positions of the observer. 
[0254] When the observer moves in the back-and-forth direction (Z-di recti on) from the reference state, the 
separation of stripes corresponding to the left and right eyes in the projected parallax image 1290 is altered by 
varying the spacing He in the horizontal direction (X-direction) of the transmitting portions 1242 of the mask pattern 
1241 without changing the composite parallax image 121 1. 

[0255] The above control always allows the proper stereoscopic observation while the projected parallax imag 
50 1290 for each of the left and right eyes at the observation position is kept as parallax images corresponding to either 
the left or right eye. 

[0256] In the description above the resolution is degraded in the vertical direction, but it is overcome so as to 
increase the resolution by altering the contents of the mask pattern 1241 and the contents of the composite parallax 
image 121 1 in synchronism as described below, as in the case of Embodim nt 3. 
55 [0257] The details of that operation will be described referring to Fig. 60 to Fig. 63. 

[0258] Fig. 60 is the same figure as Fig. 59B. Let this state be a first state. In a second state time-sequential 
thereto, as illustrat d in Fig. 61, the aperture portions of the mask pattern 1241 are moved by one pixel in the vertical 
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direction and the element stripe images of the composite parallax image 1211 are also moved by one pixel in the 
vertical direction. 

[0259] Namely, the display is switched to the composite parallax image G2(-1 to 1) illustrated in Fig. 52. 
[0260] After this operation, the sequence and position of the parallax images in the projected parallax image 
1290 are kept in those in the first state as illustrated. 

[0261] Similarly, in the third state the displays of the mask pattern 1241 and the composite parallax image 
1211 are further moved by one pixel as illustrated in Fig. 62. 

[0262] Namely, the display is switched to the composite parallax image G3(-1 to 1) illustrated in Fig. 52. 
[0263] After this operation, the sequence and position of the parallax images in the projected parallax image 
1290 are also kept in those in the first state as illustrated. 

[0264] The like operation is carried out thereafter successively to the sixth state of Fig. 63, whereby the same 
element parallax images can be displayed throughout the entire surface on the image display device without 
changing the sequence and position of the projected parallax image at the observation position. 
[0265] The stereoscopic image display with improved resolution can be effected by displaying the first to sixth 
states as a cycle within the time of the after image effect of the eyes. 

[0266] As described above, the three images are used for each of the left and right eyes, i.e., the limited number 
of original parallax images, totally six images, are used, the composite parallax image is switched one from another 
according to the pupil positions of the left and right eyes, the projected parallax image areas corresponding to the left 
and right eyes are controlled in correspondence to the pupil positions of the left and right eyes, whereby the observer 
can observe the three different parallax images through each of the pupils of the left and right eyes; this enables to 
provide the stereoscopic image display apparatus with little fatigue of the eyes while simultaneously effecting the 
convergence function by the binocular parallax images and the accommodation function of the eyes. 
[0267] Although the present embodiment showed the example of the three images for each of the left and right 
eyes, the apparatus can also be constructed in similar structure to present a plurality of, two or more, images to each 
of the left and right eyes. 

[0268] As the elements are set as described above according to the present invention, the invention 
accomplishes the stereoscopic image display apparatus that can present the image information close to the normal 
observation state to the observer, that causes no physiological contradiction between the convergence of the 
observer and the accommodation of the eyes, and that causes little fatigue during the observation of stereoscopic 
image. 

[0269] In one aspect of the present invention, the observer is allowed to observe a plurality of parallax images 
simultaneously through each pupil of the left and right eyes, which presents the effect of being capable of providing 
the stereoscopic image display apparatus with little fatigue while effecting the convergence function and the 
accommodation function of the eyes. 

[0270] Another aspect of the present invention accomplishes the effect of allowing the observer to observe a 
plurality of parallax images simultaneously through each pupil of the left and right eyes in the simple structure 
including the two cylindrical lens arrays and one mask pattern. 

[0271] Another aspect of the present invention accomplishes the effect of letting a plurality of parallax images 
simultaneously pass through the pupils of the left and right eyes, because the horizontal width of the parallax image 
areas of the vertical stripe shape is not more than half of the pupil diameter. 

[0272] Another aspect of the present invention achieves the effect of letting the accommodation function of the 
eyes act by the plurality of parallax images simultaneously passing through each pupil of the left and right eyes. 
[0273] Another aspect of the present invention can provide the stereoscopic display apparatus with little fatigue 
while effecting the convergence function and the accommodation function of the eyes and present the effect of 
enabling the stereoscopic observation area to be expanded by the tracking control of making the projection positions 
of the parallax images track the pupil positions of the observer's eyes. 

[0274] Another aspect of the present invention presents the effect of allowing the observer to observe a plurality 
of parallax images simultaneously through each pupil of the left and right ey s in the simpl structure including the 
two cylindrical lens arrays and one mask pattern. 

[0275] Another aspect of the present invention presents the effect of enabling the normal stereoscopic 
observation, irrespective of variations in the distance between the observer's eyes or irrespective of chang in the 
observation distance from the display, by changing the shape of the mask pattern and controlling the projection 
positions of the parallax images according to the eye-to-eye distance of the observer. 
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[0276] Another aspect of the present invention presents the effect of enhancing the resolution of observed 
images, by switching the mask pattern and the parallax image displayed on the display device in synchronism. 
[0277] In a stereoscopic image display apparatus for guiding a parallax image displayed on a display to the left 
eye and to the right eye of an observer by use of an optical system, thereby permitting stereoscopic observation of 

5 information of the image displayed on the display, the parallax image is comprised of a plurality of original parallax 
images for the left and right eyes and each of the left and right eyes is allowed observe the plurality of original 
parallax images simultaneously. The optical system has a vertical cylindrical lens array consisting of vertical 
cylindrical lenses having a generating line along a vertical direction, a lateral cylindrical lens array consisting of lateral 

10 cylindrical lenses having a generating line along a horizontal direction, and a mask pattern in which a plurality of 
transmitting portions and shield portions are arrayed at a predetermined pitch in the horizontal direction and in the 
vertical direction. 



15 



Claims 

1 . A stereoscopic image display apparatus comprising an observation position detecting mechanism for detecting 
an observation position of an observer and a display for displaying parallax images corresponding to the left and 
right eyes of the observer while controlling the parallax images so as to track information of the observation 
position, said stereoscopic image display apparatus permitting stereoscopic observation of the parallax images 

20 by use of the observation position detecting mechanism and the display, 

wherein the observation position detecting mechanism comprises pupil detecting means for detecting positions 
of the pupils of the eyes of the observer, and 

wherein each of the parallax images is comprised of a plurality of original parallax images for the left or right eye 
and each of the left and right eyes is allowed to observe the plurality of original parallax images. 

25 

2. The stereoscopic image display apparatus according to Claim 1 , wherein the plurality of original parallax images 
observed by said left and right eyes are parallax images taken by a plurality of photographing devices under such 
setting that a separation between the plurality of photographing devices is equal to e, where e is a value close to 

30 or not more than half of a pupil diameter p. 

3. The stereoscopic image display apparatus according to Claim 1 or 2, wherein said display forms a mask pattern 
in which a plurality of transmitting portions and shield portions are arrayed at a predetermined pitch in a horizontal 
direction and in a vertical direction, on a display surface of an optical modulator having a discrete pixel structure, 

35 light from light source means is guided to the optical modulator to form patterned beams, an image display 

device having a discrete pixel structure and displaying a composite parallax image prepared by making use of 
scan lines is illuminated through optical means with the patterned beams, and beams based on the composite 
parallax image displayed on the image display device are guided to the left and right eyes of the observer, thereby 

4Q permitting the stereoscopic observation of image information. 

4. The stereoscopic image display apparatus according to Claim 3, wherein a pattern shape of the mask pattern in 
said optical modulator is varied based on information from said pupil detecting means. 

45 5. The stereoscopic image display apparatus according to Claim 3, wherein a horizontal element of each of the 
transmitting portions in the mask pattern of said optical modulator is comprised of a plurality of pixels. 

6. A stereoscopic image display apparatus for permitting stereoscopic observation of parallax images, using 
displays for left and right eyes, each of which displays a parallax image corresponding to the left or right eye of an 
observer, 

wherein at least one of the parallax images for the left and right eyes is comprised of a plurality of original parallax 
images. 

55 7. The ster oscopic image display apparatus according to Claim 6, wherein the plurality of original parallax images 
observed by said left and right eyes are parallax images taken by a plurality of photographing devices under such 
setting that a separation between the plurality of photographing devices is equal to e, where e is a value clos to 



50 
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or not more than half of a pupil diameter p. 

8. The stereoscopic image display apparatus according to Claim 6 or 7, wherein each of said displays forms a 
mask pattern in which a plurality of transmitting portions and shield portions are arrayed at a predetermined pitch 

5 in a horizontal direction and in a vertical direction, on a display surface of an optical modulator having a discrete 

pixel structure, light from light source means is guided to the optical modulator to form patterned beams, an 
image display device having a discrete pixel structure and displaying a composite parallax image prepared by 
making use of scan lines is illuminated through optical means with the patterned beams, and beams based on 

10 the composite parallax image displayed on the image display device are guided to the left or right eye of the 

observer, thereby permitting the stereoscopic observation of image information. 

9. The stereoscopic image display apparatus according to Claim 8, wherein a horizontal element of each of the 
transmitting portions in the mask pattern of said optical modulator is comprised of a plurality of pixels. 

15 

10. A stereoscopic vision information photographing method comprising: 

a first step of photographing a first left parallax image and a first right parallax image while keeping a 
20 distance between photographing optical axes equal to k times a standard eye-to-eye distance E; and 

a second step of photographing a second left parallax image and a second right parallax image in such a 
photographing state that the distance between photographing optical axes is kept at k times the standard 
eye-to-eye distance E and that photographing positions are displaced by k times a distance e smaller than a 
25 standard pupil diameter. 



11. A parallax image forming method comprising a step of forming at least one of parallax images for left and right 
eyes by alternately arranging first parallax partial images of the one parallax image and second parallax partial 

30 

images of the one parallax image. 

12. A stereoscopic image display apparatus for guiding a parallax image displayed on a display to the left eye and 
to the right eye of an observer by use of an optical system, thereby permitting stereoscopic observation of 

35 information of the image displayed on the display, wherein said parallax image comprises a plurality of original 

parallax images for the left and right eyes and each of the left and right eyes is allowed to observe the plurality of 
original parallax images. 

13. The stereoscopic image display apparatus according to Claim 12, wherein said optical system comprises e 
40 vertical cylindrical lens array consisting of vertical cylindrical lenses having a generating line along a vertical 

direction, a lateral cylindrical lens array consisting of lateral cylindrical lenses having a generating tine along a 
horizontal direction, and a mask pattern in which a plurality of transmitting portions and shield portions are 
arrayed at a predetermined pitch in the horizontal direction and in the vertical direction. 

45 

14. The stereoscopic image display apparatus according to Claim 12, wherein said optical system guides the 
parallax image displayed on said display to the left eye and to the right eye of said observer in the form of beams 
of a vertical stripe shape, and a horizontal width of parallax image areas formed at an observation position of the 
observer by the beams of the vertical stripe shape is set to a value not more than half of a pupil diameter of the 

50 observer. 

1 5. The stereoscopic image display apparatus according to Claim 12, wherein n original parallax images (n is an 
integ r not less than 2) forming said parallax image are images taken from view point positions spaced at 
intervals of a distance equal to a value not more than half of a pupil diameter of the observer. 

55 

16. A stereoscopic image display apparatus comprising a pupil position detecting mechanism for d tecting 
positions of pupils of an observer, and an optical system for guiding beams based on a parallax image displayed 
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on a display, to th left eye and to the right eye of the observer, thereby permitting stereoscopic observation of 
information of the image displayed on the display, wh rein said parallax imag is comprised of a plurality of 
original parallax images for the left and right eyes and projected positions of the beams based on the parallax 
image are controlled according to information about the positions of the pupils of the eyes of the observer, 
outputted from the pupil position detecting mechanism, whereby the plurality of original parallax images are 
observed through each of the pupils of the left and right eyes of the observer. 

17. The stereoscopic image display apparatus according to Claim 16, wherein said optical system comprises a 
vertical cylindrical lens array consisting of vertical cylindrical lenses having a generating line along a vertical 
direction, a lateral cylindrical lens array consisting of lateral cylindrical lenses having a generating line along a 
horizontal direction, and a mask pattern in which a plurality of transmitting portions and shield portions are 
arrayed at a predetermined pitch in the horizontal direction and in the vertical direction. 

18. The stereoscopic image display apparatus according to Claim 17, wherein a pattern shape of said mask 
pattern is varied according to an eye-to-eye distance of the observer, based on the information from said pupil 
position detecting means, and the parallax images corresponding to the left and right eyes of the observer are 
controlled so as to be projected to the left and right eyes of the observer. 

19. The stereoscopic image display apparatus according to Claim 17, wherein when said n original parallax 
images (n is an integer not less than 2) are projected into n areas of a vertical stripe shape at an observation 
position, a pattern shape of said mask pattern is switched to another periodically and a display of the parallax 
image displayed on said display is also switched to another in synchronism therewith, whereby the same 
parallax images are always projected into the associated areas of the parallax image of the vertical stripe shape 
projected to the observation position. 

20. A stereoscopic image display apparatus for guiding a parallax image displayed on a display to the left eye and 
to the right eye of an observer by use of an optical system, thereby permitting stereoscopic observation of 
information of the image displayed on the display, wherein the parallax image is made by combination of six or 
more original parallax images and three or more original parallax images are observed through each of the pupils 
of the left and right eyes of the observer. 

21. The stereoscopic image display apparatus according to Claim 20, wherein said optical system comprises a 
vertical cylindrical lens array consisting of vertical cylindrical lenses having a generating line along a vertical 
direction, a lateral cylindrical lens array consisting of lateral cylindrical lenses having a generating line along a 
horizontal direction, and a mask pattern in which a plurality of transmitting portions and shield portions are 
arrayed at a predetermined pitch in the horizontal direction and in the vertical direction. 

22. The stereoscopic image display apparatus according to Claim 20, wherein said optical system guides the 
parallax image displayed on said display to the left eye and to the right eye of said observer in the form of beams 
of a vertical stripe shape, and a horizontal width of parallax image areas formed at an observation position of the 
observer by the beams of the vertical stripe shape is set to a value not more than half of a pupil diameter of the 
observer. 

23. The stereoscopic image display apparatus according to Claim 20, wherein said parallax image is made by 
combination of n original parallax images where n is an integer satisfying 6 < n and wherein the n original 
parallax images are images taken from view point positions spaced at intervals of a distance equal to a value not 
more than half of a pupil diameter of the observer. 

24. A stereoscopic image display apparatus comprising a pupil position detecting mechanism for detecting 
positions of pupils of an observer, and an optical system for guiding b ams based on a parallax image displayed 
on a display, to the left eye and to the right eye of the observer, thereby permitting stereoscopic observation of 
information of the image displayed on the display, wherein said parallax image is made by combination of six or 
more original parallax images, and projected positions of the beams bas d on the parallax image are controll d 
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according to information about th positions of the pupils of the eyes of the observer, outputted from the pupil 
position detecting mechanism, whereby three or more original parallax images are observed through each of the 
pupils of the left and right eyes of the observer. 

25. The stereoscopic image display apparatus according to Claim 24, wherein said optical system comprises a 
vertical cylindrical lens array consisting of vertical cylindrical lenses having a generating line along a vertical 
direction, a lateral cylindrical lens array consisting of lateral cylindrical lenses having a generating line along a 
horizontal direction, and a mask pattern in which a plurality of transmitting portions and shield portions are 

10 arrayed at a predetermined pitch in the horizontal direction and in the vertical direction. 

26. The stereoscopic image display apparatus according to Claim 25, wherein a pattern shape of said mask 
pattern is varied according to an eye-to-eye distance of the observer, based on the information from said pupil 
position detecting means, and the parallax images corresponding to the left and right eyes of the observer are 

15 controlled so as to be projected to the left and right eyes of the observer. 

27. The stereoscopic image display apparatus according to Claim 25, wherein said parallax image is made by 
combination of n original parallax images where n is an integer satisfying 6 < n, and wherein when said n original 

2Q parallax images are projected into n areas of a vertical stripe shape at an observation position, a pattern shape of 

said mask pattern is switched to another periodically and a display of the parallax image displayed on said 
display is also switched to another in synchronism therewith, whereby the same parallax images are always 
projected into the associated areas of the parallax images of the vertical stripe shape projected to the observation 
position. 

25 
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FIG. 7 
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